A bound on the mutual information, and properties of entropy reduction, for 
quantum channels with inefficient measurements 
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The Holevo bound is a bound on the mutual information for a given quantum encoding. In 1996 
Schumacher, Westmoreland and Wootters [Schumacher, Westmoreland and Wootters, Phys. Rev. 
Lett. 76, 3452 (1996)] derived a bound which reduces to the Holevo bound for complete measure- 
ments, but which is tighter for incomplete measurements. The most general quantum operations 
may be both incomplete and inefficient. Here we show that the bound derived by SWW can be 
further extended to obtain one which is yet again tighter for inefficient measurements. This allows 
us in addition to obtain a generalization of a bound derived by Hall, and to show that the average 
reduction in the von Neumann entropy during a quantum operation is concave in the initial state, 
for all quantum operations. This is a quantum version of the concavity of the mutual information. 
We also show that both this average entropy reduction and the mutual information for pure state 
ensembles, are Schur-concave for unitarily covariant measurements; that is, for these measurements, 
information gain increases with initial uncertainty. 

PACS numbers: 03.67.-a,03.65.Ta,89.70.+c,02.50.Tt 



I. INTRODUCTION 

The celebrated Holevo bound, conjectured by Gor- 
don Q and Levitin and proved by Holevo in 1973 
gives a bound on the information which may be trans- 
mitted from A to B (strictly, the mutual information, 
M , between A and B) when A encodes information in a 
quantum system using a set of states {pi}, chosen with 
probabilities {P(i)}, and B makes a subsequent measure- 
ment upon the system. The Holevo bound is 



M{I:J) <x^ S{p) - Y,P{t)S{p.,), 



(1) 



where p — '^iP{'i)pi (and which we will refer to as the 
ensemble state). We write the mutual information as 
M{I : J) to signify that it is the mutual information be- 
tween the random variables / and J, whose values i and j 
label respectively the encoding used by A, and outcome 
of the measurement made by B. More recent proofs of 
the Holevo bound may be found in Rcfs. i, i i The 
bound is achieved if and only if the encoding states, pi, 
commute with each other, and the receiver, B, makes a 
von Neumann measurement in the basis in which they 
are diagonal. (A von Neumann measurement is one that 
projects the system onto one of a complete set of mu- 
tually orthogonal states. In this case the set of states 
is chosen to be the basis in which the coding states are 
diagonal.) With this choice of coding states and mea- 
surement the channel is classical, in that it can be im- 
plemented with a classical system. The Holevo bound 
takes into account that the sender may only be able to 
send mixed states, and this mixing reduces the amount of 
information that can be transmitted. However, if the re- 
ceiver is not able to perform measurements which always 
project the system to a pure state (so called complete 
measurements), then in general the information will be 



further reduced. In 1996 Schumacher, Westmoreland and 
Wootters showed that when the receivers measurement is 
incomplete, it is possible to take this into account and de- 
rive a more stringent bound on the information. If the 
receiver's measurement is the POVM described by the 
operators {Aj} (with = l)i so that the mea- 

surement outcomes are labeled by the index j, then the 
SWW bound is 



A/(/:J)<X-E^(j) 



Xj, 



(2) 



where P{j) is the probability of outcome j 0, and Xj 
is the Holevo quantity for the ensemble that the system 
remains in (from the point of view of the receiver) , given 
outcome j. This bound can be at least partially under- 
stood by noting that if the system still remains in some 
ensemble of possible states after the measurement, then 
future measurements can potentially extract further in- 
formation about the encoding, and so the information 
obtained by the first measurement must therefore be less 
than the maximum possible by at least by this amount. 
What the SWW bound tells us is that the bound on the 
information is reduced not only by the amount of infor- 
mation which could be further extracted after outcome 
j has been obtained, but by the Holevo bound on this 
information, Xj- 

If the initial state of the system is pi, then after 
outcome j the final state of the system is given by 
PjH = AjPiA'j/Ti-[A'jAjPi]. Thus the states which make 
up the final ensemble that remains after outcome j, are 
{pj\i}, and the probability of each state in the ensemble 

is P{i\j) = P{j\i)P{i)/P{j), with P{j\i) = Tt[A]AjP,]. 
The Holevo quantity for ensemble j is thus 



Xj 



s{p,)-j2pmsip,\,), 



(3) 
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where pj = AjpAj/TT[A^jAjp]. If at least one of the mea- 
surement operators Aj are higher than rank 1, then the 
measurement is incomplete. If the measurement is com- 
plete, then for each j all the final states pj\i are identical, 
Xj is zero and the SWW bound reduces to the Holevo 
bound. 

The most general kind of measurement can also be 
inefficient. A measurement is described as inefficient if 
the observer does not have full information regarding 
which of the outcomes actually occurred. The name in- 
ejficient comes from that fact that the need to consider 
such measurements first arose in the study of inefficient 
photo-detectors. j3| An inefficient measurement may be 
described by labeling the measurement operators with 
two indices, so that we have Akj. The receiver has com- 
plete information about one of the indices, j, but no in- 
formation about the other, fc. As a result the final 
state for each j (given the value of i) is now 

Er>n \ ■\ ^k]PiA\ 

Since inefficiency represents a loss of information, we wish 
to ask whether it is possible to take this into account and 
obtain a more stringent bound on the mutual informa- 
tion. If we merely apply the SWW bound to the measure- 
ment Akj , then the bound involves the Holevo quantities 
of the ensembles that remain when both the values of k 
and j are known (the final ensembles that result from the 
efficient measurement). That is 

One therefore wishes to know whether it is possible to 
derive a bound which instead involves the Holevo quan- 
tities of the ensembles that remain after the inefficient 
measurement is made, that is, for the receiver who only 
has access to j. 

In the first part of this paper we answer this question 
in the affirmative - for an inefficient measurement where 
the known outcomes are labeled by j, the bound given 
by Eq. Q remains true, where now the Xj are the Holevo 
quantities for the ensemble of states p'j^^ which result from 
the inefficient measurement. 

In the second part of the paper, we consider the aver- 
age reduction in the von Neumann entropy induced by a 
measurement: 

{ASip))^S{p)-J2Pij)Sip'^). (6) 

i 

Here p'j is the state that results from outcome j, given 
that the initial state is p. Since the von Neumann entropy 
is a measure of how much we know about the state of 
the system, this is the difference between what we knew 
about the system state before we made the measurement, 
and what we know (on average) about the system state at 
the end of the measurement; it thus measures how much 



we learn about the final state of the system. Equivalcntly, 
it can be said to measure the degree of "state-reduction" 
which the measurement induces. 

While it is the mutual information which is important 
for communication, the reduction in the von Neumann 
entropy is important for feedback control. Feedback con- 
trol is the process of performing a sequence of measure- 
ments on a system, and applying unitary operations after 
each measurement in order control the evolution of the 
system. Such a procedure is useful for controlling sys- 
tems which are driven by noise. If the ability to perform 
unitary operations is unlimited, then the von Neumann 
entropy provides a measure of the level of control which 
can be achieved: if the system has maximal entropy then 
the unitary operations have no effect on the system state 
whatsoever; conversely, if the state is pure then the sys- 
tem can be controlled precisely - that is, any pure state 
can be prepared. Thus the entropy measures the extent 
to which a pure state, or pure evolution can be obtained, 
and thus the level of predictability which can be achieved 
over the future behavior of the system |lOl | . The primary 
role of measurement in feedback control is therefore to 
reduce the entropy of the system. As such the average 
reduction in von Neumann entropy provides a ranking of 
the effectiveness of different measurements for feedback 
control, other things being equal. Further details regard- 
ing quantum feedback control and von Neumann entropy 
can be found in reference. [Tlj 

The entropy reduction is also relevant to the transfor- 
mation of pure-state entanglement, since the von Neu- 
mann entropy measures the entanglement of pure states. 
As a result this quantity gives the amount by which pure- 
state entanglement is broken by a local measurement. 

We give two corollaries of the general information 
bound derived in the first part which involve {AS{p)). 
The first is a generalization of a bound derived by 
Hall [T^ IT^ to inefficient measurements. Hall's bound 
states that for efficient measurements the mutual infor- 
mation is bounded by {AS{p)). Wc show that for ineffi- 
cient measurements this becomes 

M(/:J) < {AS{p))-Y,P{t){AS{p,)), (7) 

i 

where {AS{pi)) is the average entropy reduction which 
would have resulted if the initial state had been pi, and 
as above p = J2i P{i)Pi - 

The second is the fundamental property that, for all 
quantum operations, the average reduction in von Neu- 
mann entropy is concave in the initial state p. That is 

{AS{p))>Y,P{i){AS{p.)). (8) 

i 

Finally, in the third part of this paper, we use the above 
result to show that for measurements which are uniform 
in their sensitivity across state-space (that is, measure- 
ments which are unitarily covariant), the amount which 
one learns about the final state always increases with 
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the initial uncertainty, where this uncertainty is charac- 
terized by majorization. This is a quantum version of 
the much simpler classical result (which we also show) 
that the mutual information always increases with the 
initial uncertainty for classical measurements which are 
permutation symmetric. In addition we show that, for 
unitarily covariant measurements, the mutual informa- 
tion for pure-state ensembles also has this property. One 
can sum up these results by saying that the statement 
that information gain increases with initial uncertainty 
can fail to hold only if the measurement is asymmetric 
in its sensitivity. 



II. AN INFORMATION BOUND FOR 
GENERAL QUANTUM OPERATIONS 

We now show that the bound proved by SWW can be 
generalized to obtain a more stringent bound for chan- 
nels in which the receivers measurement is inefhcient. To 
show this it turns out that we can use the same method 
employed by SWW, but with the addition of an extra 
quantum system which allows us to include the inefh- 
ciency of the measurement. 

Theorem 1. For a quantum channel in which the en- 
coding ensemble is e = {P{i), pi\ , and the measurement 
performed by the receiver is described by operators A^j 

(J2kj "^Ij^kj = 1 j; where the measurement is in general 
inefficient so that the receiver knows j but not k, then 
the mutual information, M{I:J), is bounded such that 



M{I:J)<x-Y.P{j) 



Xj, 



(9) 



where P{j) is the overall probability for outcome j , x = 
S'(p) — P(i)/S'(yOi) is the Holevo quantity for the initial 
ensemble and 



(10) 



is the Holevo quantity for the ensemble, Ej, that remains 
(from the point of view of the receiver) once the measure- 
ment has been made, so that the receiver has learned the 
outcome j , but not the value of k. Here the receiver's 
overall final state is 



P{J) 



^kj I i 7 



(11) 



where P(i, k\j) is the probability for both i and outcome 
k given j , and akj\i is the final state that results given 
the initial state pi, and both outcomes j and k. The re- 
maining ensemble Sj = {P{i\j),(7j\i}, where 

X — ^ ^ J y A-j^jPiA^i^- 



and where P{k\j, i) is the probability for outcome k given 
j and the initial state pi. 



Proof. We begin by collecting various key facts. The first 
is that any efhcient measurement on a system Q, de- 
scribed by = A^iA^2 operators, Akj, (j ~ l,...,Ni 
and k = 1, . . . ^N-i) can be obtained by bringing up an 
auxiliary system A of dimension N , performing a uni- 
tary operation involving Q and A, and then making a 
von Neumann measurement on If the initial 

state of Q is p''^-', then the final joint state of A and Q 
after the von Neumann measurement is 



kj 



P{k,j) 



(13) 



where \kj) is the state of A selected by the von Neumann 
measurement. The second fact is that the state which re- 
sults from discarding all information about the measure- 
ment outcomes k and j can be obtained by performing 
a unitary operation between A and another system E 
which perfectly correlates the states \kj) of A with or- 
thogonal states of E, and then tracing out E. The final 
key fact we require is a result proven by SWW Q , which 
is that the Holevo x quantity is non-increasing under par- 
tial trace. That is, if we have two quantum systems A 
and B, and an ensemble of states p, 
probabilities Pi, then 



(AB) 



with associated 



X 



(A) 



< 



sip^^^^)-j2s{p: 



AAB) 



(14) 



where p^^"^ = Tr^ [pY^'^^- To prove this result SWW use 
strong subadditivity. [l3 

We now encode information in system Q using the en- 
semble £, and consider the joint system which consists 
of the three systems Q, A, E and a forth system M, 
with dimension A^i. We now start with A, E and M in 
pure states, so that the Holevo quantity for the joint sys- 
tem is = We then perform the required 
unitary operation between Q and A, and a unitary op- 
eration between A and E which perfectly correlates the 
states \kj)^^^ of A with orthogonal states of E. Unitary 
operations do not change the Holevo quantity. Then we 
trace over E, so that we are left with the state 



AAB) 



\i^){^P\^'''>'E)Y,P{k,J)\k,J){k,J\^^h. 

jk 



Ak.P^^^Al 
P{k,j) 



(15) 



After the two unitaries and the partial trace over E, the 
Holevo quantity for the remaining systems, which we will 

denote by x'(^^^^\ satisfies x'^*^"^*^^ < x^*^^^^^^ = X^*^^- 
We now perform one more unitary operation, this time 
between M and A, so that we correlate the states of M, 
which we denote by with the second index of 

the states of A, giving 



(Q) 

kj 



(16) 
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where cr^^^ = Akjp'^'-^^Al./P{k,j) is the final state re- 
sulting from knowing both outcomes k and j, with no 
knowledge of the initial choice of i. Finally we trace out 
A, leaving us with the state 



(Q) 
kj 



(17) 



After this final unitary, and the partial trace over A, 
the Holevo quantity for the remaining systems Q and 
M, which we will denote by x"^'^'^'\ satisfies x"^^^^'' < 
^/(QAM) -^(Q) ^ have gone through the above pro- 
cess using the initial state p, but we could just as eas- 
ily have started with any of the initial states, pi, in the 
ensemble, and we will denote the final states which we 



obtain using the initial state pi as tr. 



(QM) 



Calculating 



X 



ti{QM) 



i 



= M(J:/) + E^(j)xf' < 



(Q) <- ^(Q) 



X' 



(18) 



(19) 



Rearranging this expression gives the desired result. □ 



III. PROPERTIES OF ENTROPY REDUCTION 

We now rewrite the above information bound using the 
fact that P{i\j)P{j) = P{j\i)P{i). The result is 

M{I:J) < (A5(p)) -E^W(A^(pO) (20) 

i 

where p = '^iPiPi- Ozawa has shown that for efficient 
measurements {AS{p)) is always positive 0| (for more 
recent proofs of this result see[i^[l3)- For efficient mea- 
surements Ea. (|20|l is therefore in general stronger than, 
and gives immediately. Hall's bound il^lSi which states 
that the mutual information is bounded by the reduction 
in the von Neumann entropy. The inequality in Ea. l|2UI) 
is then a generalization of Hall's bound to inefhcient mea- 
surements. Since the mutual information is always pos- 
itive, but for inefficient measurements the reduction in 
the von Neumann entropy can be negative (that is the 
entropy of the quantum state can increase as a result of 
the measurement), the relation 



M{P.J) < {AS{p)) 



(21) 



is not necessarily satisfied for such measurements. How- 
ever, Ea. (|20|l tells us that if the entropy of the intial state. 



p, does increase, the average increase in the entropy for 
each of the coding states pi is always more that this by 
at least the mutual information. 

The second result that we obtain from Ea. (|20|l is that, 
because the mutual information is nonnegative, we have 



{AS{p))>Y,P{z){ASip,)). 



(22) 



That is, the reduction in the von Neumann entropy is 
concave in the initial state. This parallels the fact that 
the mutual information is also concave in the initial state. 

The fact that this is true for inefficient measurements, 
means that once we have made an efficient measurement, 
no matter what information we throw away regarding the 
final outcomes (i.e. which outcomes we average over), 
{AS{p)) is always greater than the average of the entropy 
reductions which would have been obtained through mea- 
surement in each of the coding states, when we throw 
away the same information regarding the measurement 
results. 



IV. INFORMATION GATHERING AND 
STATE-SPACE SYMMETRY 

In this section we show that measurements whose abil- 
ity to extract information is uniform over the avail- 
able state-space (that is, does not vary from point to 
point in the state-space) always extract more information 
(strictly, never extract less information) the less that is 
known before the measurement is made. Thus, in this 
sense, one may regard "the more you know, the less you 
get" as a fundamental property of measurement. We 
will show that this is true both for the information ob- 
tained regarding the final state (being {AS{p))), and the 
mutual information for a measurement on an ensemble 
of pure states. We will consider here efficient measure- 
ments only; no doubt inefficient measurements will also 
have this property, but only if the information which is 
thrown away is also uniform with respect to the state- 
space, and we do not wish to burden the treatment with 
this additional complication. 

To proceed we must make precise the notion that the 
sensitivity of a measurement is uniform over state-space. 
This is captured by stating that such a measurement 
should be invariant under reversible transformations of 
the state-space. For classical measurements (which are 
simply quantum measurements in which all operators and 
density matrices commute |20j ') this means that the set 
of measurement operators is invariant under all permuta- 
tions of the classical states: we will refer to these as com- 
pletely symmetric measurements. Note that in this clas- 
sical case, this is equivalent to saying that the measure- 
ment distinguishes all states from all other states equally 
well. The quantum generalization of this is invariance 
under all unitary transformations. Such measurements 
arc referred to as being unitarily covariant. |^ 
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We must also quantify what we mean by the observer's 
lack of knowledge, or uncertainty, before the measure- 
ment is made. This is captured by the simple and elegant 
concept of majorization. [23L |23 | If two sets of probabil- 
ities p = {Pi} and q = {Qi} satisfy the set of relations 



(23) 



where it is understood that the elements of both sets have 
been placed in decreasing order (e.g., Pj > P^+i, Vi), then 
p is said to majorize q, and this is written q < p. While 
at first Ea. (|23|l looks a little complicated, a few moments 
consideration reveals that it captures precisely what one 
means by uncertainty - if p majorizes q, then p is more 
sharply peaked than g, and consequently describes a state 
of knowledge containing less uncertainty. What is more, 
majorization implies an ordering with Shannon entropy 
H[-]. That is, if p majorizes q, then H[p] < H[q]. [2ll2i| 
In a sense, majorization is a more basic notion of uncer- 
tainty than entropy in that it captures that concept alone 
- the Shannon entropy on the other hand characterizes 
the more specific notion of information. To characterize 
the uncertainty of a density matrix, we can apply ma- 
jorization to the vector consisting of its eigenvalues. If p 
and (J arc density matrices, then we will write a ^ p ii 
p's eigenvalues majorize cr's. Various applications have 
been found for majorization in quantum information the- 

ory. CI Em El mm 

We thus desire to show that for measurements with the 
specified symmetry, {AS (a)) > (AS{p)) whenever a ^ p 
(and similarly for the mutual information). Functions 
with this property (of which the von Neumann entropy, 
S{p), is one example) are referred to as being Schur- 
concave. To show that a function is Schur-concave, it is 
sufficient to show that it is concave, and symmetric in 
its arguments [23, 13 , which in our case are the eigen- 
values of the density matrix p (if our functions did not 
depend only on the eigenvalues of p, then they could not 
be Schur-concave, since the majorization condition only 
involves these eigenvalues). 

The desired result for classical completely symmetric 
measurements is now immediate. In the classical case the 
mutual information is the unique measure of information 
gain, and M{I : J) = {AS{p)). The mutual informa- 
tion is concave in the initial classical probability vector 
P = (Pi, . . . , P„) (being the vector of the eigenvalues of 
p in our quantum formalism), as is indeed implied by the 
concavity of {AS{p)). Since all operators commute with 
the density matrix. {AS{p)) is only a function of the {Pi}. 
From the form of {AS{p)) we see that a permutation of 
the elements of P is equivalent to a permutation applied 
to the measurement operators, and since these are invari- 
ant under such an operation, {AS{p)), and thus M{I:J), 
is a symmetric function of its arguments. Thus M{I:J) 
is Schur-concave. 

The Schur-concavity of {AS{p)) for unitarily covariant 
(UC) quantum measurements is just as immediate. Be- 



cause of the unitary covariance of the measurement, we 
see from the form of {AS{p)) that it is invariant under a 
unitary transformation of p. As a result, it only depends 
upon the eigenvalues of p. Since the permutations are 
a subgroup of the unitaries, it is also a symmetric func- 
tion of its arguments (the eigenvalues), and thus Schur- 
concave. 

We wish finally to show that the mutual information is 
also Schur-concave in p for unitarily covariant measure- 
ments on ensembles of pure states. This requires a little 
more work. First we need to show that once we have 
fixed a set of encoding states, the mutual information is 
concave in the vector of the ensemble probabilities P{i). 
This is straightforward if we first note that the mutual 
information, because it is, in fact, symmetric between i 
and J, can be written in the reverse form 

M{I:J) = H[P{j)]-Y,Pi^)H[Pmi (24) 

j 

Since, for a fixed measurement, the mutual information is 
a function of the ensemble probabilities wc will write it as 
M{{P{i)}). Denoting the pure states in the encoding en- 
semble as Pi = \tpi){^pi\, and choosing the ensemble state 
p = "^^^Pkf^k, where the at are built from the encoding 
states so that Uk = then 

M{{P{i)}) 

= F[^P(fc)P(j|fc)] -^^P(*|fc)P(fc)i/[P(jW] 



> ^ p{k)H[p{j\k)] - J2 pmrnpim 

k k i 

= ^P(fc)A/({P(z|ft)}), (25) 

being the desired concavity relation. The inequality in 
the third line is merely a result of the concavity of the 
Shannon entropy. Note that while we have written the 
measurement's outcomes explicitly as being discrete in 
the about derivation, the result also follows if they are 
a continuum (as in the case of UC measurements) by 
replacing the relevant sums with integrals. 

Now we need to note some further points about UC 
measurements: A UC measurement may be generated 
by taking all unitary transformations of any single oper- 
ator A, and dividing them by a common normalization 
factor. The resulting measurement operators are thus 
Ajj oc UAW, where U ranges over all unitaries. The 
normalization for the Ajj comes from J U A'' AU"^ dp{U) ~ 
Tr[A^ A]I where dp{U) is the (unitarily invariant) Haar 
measure 0, ^1 over unitaries. 

It is not hard to show that all UC measurements can be 
obtained by mixing different UC measurements, each gen- 
erated by a different operator. (Mixing a set of measure- 
ments means assigning to each a probability, and then 
making one measurement from the set at random based 
on these probabilities |30l|). 

Next, we need to show that for all UC measurements 
the mutual information depends only on the eigenvalues 
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of the ensemble density matrix, and we state this as the 
foUowing lemma. 

Lemma 1. The mutual information for a UC measure- 
ment on a pure-state ensemble, e = {P(i), IV'i)} depends 
on the ensemble only through the eigenvalues of the den- 
sity matrix p = J2i Pi'^)\'^i){^t\- 

Proof. We first show this for UC measurements generated 
from a single operator. Writing the mutual information 
in the reverse form one has 

M{I:J)) = H[P{U)]-Y,P,H[Pm)], (26) 



where U is the continuum index for the measurement op- 
erators (and thus the measurement outcomes) which are 
All = UAW for some appropriately normalized A. Nat- 
urally all this means is that P{U\i) is a function of U, 
where U ranges over all unitaries. Since the measurement 
is unitarily covariant, H[P{U\i)] is the same for all initial 
states iV'i), and therefore the second term is the same 
for all initial ensembles. Thus M depends only on the 
first term H[P{U)] = i?[Tr[J7AUC/tp]], which depends 
only on p, and is invariant under all unitary transforma- 
tions of p. Thus M depends only on the eigenvalues of 
p. Since the mutual information for a mixture of mea- 
surements is merely a function of the respective mutual 
informations for each measurement (in particular it is a 
linear combination of them), the result holds for all UC 
measurements. □ 

Since M depends only on p, in establishing the Schur 
concavity of M with respect to p, we need only consider 
one ensemble for each p. We therefore choose the eigen- 
ensemble {Xi, \(f>i)}, where and {(pi) are the eigenvalues 
and eigenvectors of p respectively. We know that the mu- 
tual information is concave in the vector of initial ensem- 
ble probabilities, and for the ensemble we have chosen, 
the initial probabilities are the eigenvalues of p. As a re- 
sult the mutual information is concave in the eigenvalues 
of p. Since M is invariant under unitary transformations, 
and since unitary transformations include permutations 
as a subgroup, it is also a symmetric function of the eigen- 
values. Thus M is Schur-concave. 



V. CONCLUSION 

In using a quantum channel, if there are limitations 
on the completeness (or alternatively the strength, in the 
terminology of or efficiency of the measurements 

that the receiver can perform, then it is possible to give 
a bound on the mutual information which is stronger 
than the Holevo bound. Further, this bound has a very 
simple form in terms of the Holevo x quantity, and the 
X quantities of the ensembles, one of which remains after 
the measurement is made. 

This bound also allows us to obtain a relationship be- 
tween the mutual information and the average von Neu- 
mann entropy reduction induced by a measurement, and 
encompasses the fact that this von Neumann entropy re- 
duction is concave in the initial state. 

From the concavity of the mutual information and the 
von Neumann entropy reduction, it follows that these 
quantities are Schur-concave (the former naturally for 
pure-state ensembles) for completely symmetric classi- 
cal measurements, and for unitarily covariant quantum 
measurements. Thus the possibility that either of these 
kinds of information gain decreases with increasing ini- 
tial uncertainty is associated with the asymmetry of the 
measurement in question. 
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